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Abstract 



A recent theorem of Bissacot, et al. proved using results about the clus- 
ter expansion in statistical mechanics extends the Lovasz Local Lemma 
by weakening the conditions under which its conclusions holds. In this 
note, we prove an algorithmic analog of this result, extending Moser and 
Tardos's recent algorithmic Local Lemma, and providing an alternative 
proof of the theorem of Bissacot, et al. applicable in the Moser-Tardos 
algorithmic framework. 

1 Introduction 

If events Ai,A2, . . . , A„ are independent, then we have P(p| A^)) > so long 
as P(^i) < 1 for each i. A central tool in probabilistic combinatorics is the 
Lovasz Local Lemma proved by Erdos and Lovasz [5], which can be seen as 
generalizing this simple fact to situations where some dependencies among the 
Ai are allowed, in exchange for better bounds on the probabilities P{Ai). 

The Local Lemma is commonly presented through the framework of a de- 
pendency graph on the events Ai, where if C is any family of non- neighbors of 
some Ai, then we have that Ai is independent of the family C of events. The 
Lovasz Local Lemma is then as follows: 

Theorem 1.1 (Lovasz Local Lemma). Let G he any dependency graph for a 
finite family A of events, and suppose that there are real numbers < xa < 1 
{A G A) such that for all A & A we have 



P(A) <xa\{{ 1 - xb)- 



(1) 



B~A 



Then 
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and so in particular, we have 

p ( n ^ ) > 0- (2) 

\AeA I 

The first breakthrough in finding an algorithmic version of the Local Lemma 
was made by Beck, who demonstrated his method on the classical Local Lemma 
application to 2-colorable hypergraphs. Beck's method was subsequently refined 
and given a more general framework |lii4i i9iil4j , but required stronger bounds on 
the probabilities of the events than were required by the nonalgorithmic version. 

In Moser and Tardos' recent breakthrough paper [lOJ, they give an algorith- 
mic proof of the Lovasz Local Lemma in a setting which is general enough for 
nearly all applications of the Lemma in combinatorics, with bounds identical 
to those required by the nonalgorithmic version. In the framework Moser and 
Tardos consider, the events in A depend on some underlying set V of indepen- 
dent random variables, and they denote by vbl(A) {A G A) the minimal set of 
random variables from V on which each A depends; A is said to be 'violated' 
with respect to a particular evalation of the variables in vbl(A) if the event 
occurs for that evaluation. A Moser- Tardos dependency graph is one which 
implies that if events A and B are nonadjacent, then vbl(A) is disjoint from 
vbl(i?). (Note that this notion of a dependency graph is more restrictive than 
the Lovasz version based on probabilistic independence, as is demonstrated by 
an example of Kolipaka and Szegedy [8].) Moser and Tardos's theorem is then 
the following: 

Theorem 1.2 (Moser and Tardos). Let V he a finite set of mutually independent 
variables in a probability space, and let A be a finite family of events determined 
by these variables. If there are real numbers < xa < ^ (A G A) such that 

PiA) <xaY[{1- xb) (3) 

then there exists an assignment to the variables V which corresponds to no oc- 
currence of any event from A. Moreover, the randomized algorithm described 
below resamples an event A at most an expected j-rjj times before finding the 
evaluation, thus the total number of resampling steps is X^Ae^ i-xa expec- 
tation. 

The Moser- Tardos algorithm consists just of beginning with a random evalu- 
ation of all the variables in V, and then resampling vbl(^) for any violated 
events A until no violated events remain. Of course, the efficiency of the algo- 
rithm depends on the ability to resample variables efficiently and check whether 
individual events are violated; this is generally an easy implementation problem, 
however, making the analysis of the number of resampling steps the important 
issue. 

Recently, Bissacot, Fernandez, Procacci and Scoppola proved the following 
improvement of the Lovasz Local Lemma: 
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Theorem 1.3 (Bissacot, et al. Consider a finite family A of events in some 
probability space VL, with some dependency graph G. If there are real numbers 
< /iA < oo such that 

P{A) < ^^1, (4) 



E n 

icr(A) Bel 

I indop. 



Ms 



then P[ n ^ > 0. 

It is not difficult to check that condition dH) is weaker than condition ([T|) by 
considering the substitution ha = rz^- (Condition ([T]) would be equivalent to 
^ without the condition in the sum that the sets / be independent.) In [3], 
they also give examples where this theorem improves some classical theorems 
proved with the Local Lemma. Theorem 11.31 has also since been applied to 
improve some theorems on graph colorings in |llj . 

Their proof of Theorem ll.3l is based on Shearer's characterization of labeled 
dependency graphs to which the conclusion of the Local Lemma applies [13] 
and two of those authors' recent results on the radius of convergence of logs 
of partition functions [7]. (The connection between the Local Lemma and the 
partition functions of statistical mechanics was first made by Scott and Sokal 

In this short note, we prove an algorithmic analog to the result of Bissacot, 
et. al. That is, we will show that in the setting of Moser and Tardos's algo- 
rithmic Local Lemma, Moser and Tardos's bounds on the running time of their 
algorithm hold even with their condition Q replaced with condition (|4]) : 

Theorem 1.4. Let V be a finite set of mutually independent variables in a 
probability space, and let A be a finite family of events determined by these 
variables. If there are real numbers < < oo (A € A) such that 

P{A) < ^^tr ^ (5) 



E n 

icr(A) Bel 

I indep. 



then there exists an assignment to the variables V which corresponds to no oc- 
currence of any event from A. Moreover, the Moser-Tardos algorithm resamples 
an event A at most an expected ha times before finding the evaluation, thus the 
total number of resampling steps is J2 I'' A in expectation. 

AdA 

(The running time bound here is equivalent to the Moser-Tardos bound under 
the substituation a a — ^'^ ■) 

The proof of Theorem ll .41 consists simply of re-doing one part of the proof of 
Moser and Tardos's theorem, taking advantage of some constraints which were 
not necessary for Moser and Tardos's original result. 

Theorem 11.41 can be seen as doing two things: first, it extends the result 
of Moser and Tardos by giving a weaker condition under which the identical 
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result holds — note that this has also been done in a more general sense by 
Kolipaka and Szegedy 0, who directly connect Shearer's condition with the 
Moser/Tardos algorithmic framework. Secondly, it gives an alternative proof of 
the result of Bissacot, et al. (in the slightly more restrictive algorithmic setting) 
which is independent of Shearer's theorem and the cluster expansion methods 
used in [?]■ 

Bissacot, et al. note that their Theorem 11.31 can be extended to Lopsided 
dependency graphs, first considered by Erdos and Spencer in 6 . In their pa- 
per on their algorithmic Local Lemma, Moser and Tardos define an analog of 
lopsidependency in the algorithm/ variable setting, and a reader familiar with 
Moser and Tardos 's paper can easily verify that our improvement to Moser and 
Tardos's theorem applies to their theorem on algorithmic lopsided dependency 
graphs as well, as we only re-do their branching argument, which is applied to 
the lopsided case in the same way as in their main result. 

2 Proof 

The Moser- Tardos algorithm is as follows: 
1: procedure Moser-Tardos(P) 
2: for all P € "P do 
3: vp -s— (random evaluation of P) 

4: end for 

5: while 3A s.t. A is violated when P — vp (VP) do 
6: for aU P e vhl{A) do 

7: Vp -s— (new random evaluation of P) 

8: end for 

9: end while 
10: end procedure 

(Note that when multiple events exist satisfying line [51 one of the satisfying 
events is chosen arbitrarily.) 

Moser and Tardos' proof that this algorithm terminates in polynomial time 
(under condition ([3])) is based on the notion of a 'witness tree'. As the algorithm 
runs and bad events are found and resampled, a witness tree is assigned to each 
step of the algorithm (where a step consists of a resampling of an event). A 
witness tree is a rooted tree with labels from A. The witness tree Wt for step 
t of the algorithm is constructed as follows: choose as its root a vertex labeled 
with whatever event Aq was resampled at step t. If the event Ai which was 
resampled at step t — 1 overlaps the label of the root, a vertex is added as a 
child of the root labeled with Ai. (We may have Ai = Aq.) In general, for each 
step i = t — — 2,...,lof the algorithm, if the event Ai which was added 
at step i overlaps any of the events currently labels of vertices of our partially 
constructed Wt, we add a vertex labeled with Ai as the child of a vertex of 
maximum depth whose label overlaps Ai. In the result, Wt, children always 
overlap their parents, and children of a common parent always get distinct 
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labels (otherwise, whichever was added after the other would have been added 
as a child of the other). Any tree T with labels from A with these two properties 
is called a proper witness tree. 

Moser and Tardos's proof of their algorithm's efficiency consists of two parts: 
first, they show that any proper witness tree T has probability at most 



n (6) 



of occurring as a witness tree at any point in the running of the algorithm, 
where here Ay denotes the event labeling the vertex v. 

Now, if an event A is resampled at step t, the number of occurrences of A 
as a label in the witness tree Wt is equal to the number of times A has been 
resampled on steps 1, . . . , t — in particular, all witness trees which will occur in 
a run of the algorithm will be distinct. Thus if we let Ta denote the set of 
proper witness trees with root label A, the expected value of the number Na of 
resamplings of A which occur in a run of the algorithm is equal to 

¥^{Na)= Y1 PC?" occurs in the log) < ^ J| P(A^,). (7) 

TeTA TeTA vGT 

The second part of Moser and Tardos's proof consists of bounding the sum 
of products in line ([T]). They do this by considering a random process for 
constructing trees: Suppose xa (A G A) are real numbers between and 1. 
Fix now any event Aq. In the first round of the process, a vertex labeled Ag is 
created. In each subsequent round, for each event vertex v with label Ay created 
in the previous round, and for each event A„ G f (A„) (in the dependency graph), 
a vertex u with label A„ is added as a child of v with probability Xa„ ■ (AH of 
these choices are are made independently.) 

Moser and Tardos prove: 

Lemma 2.1 (Moser Tardos Branching Lemma). For any proper witness tree T 
with root labeled Aq, the probability px that the process above produces exactly 
the tree T is 

PT^^-^^W \xA. II {1-xb)\. (8) 



n (^^^ n (1-^^)) 



Thus, the Lemma gives us that 



1^ Ep-^^e nf--^ n(i--)) 



□ 



(9) 



Thus the bound P{A) < {xa Yls^Ai^ ~ ^b)) for all A implies, together with 
line 0, that 

E(A^^) < (10) 

1- XA 
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Our improvement comes just from a slightly more careful branching argu- 
ment. Note that any witness tree which occurs in the log of the algorithm 
has the property that any children of a common vertex have labels which are 
nonadjacent in the dependency graph. This condition — let's call it strongly 
proper — is stronger than requiring simply that children be distinct. Thus, we 
can strengthen line [71 as we have the bound 

E(7Va) J2 occurs in the log) < XI 11 (H) 

Terf Terf ueT 

where C 7a is the set of strongly proper witness trees. 

To bound the sum in we consider a modified branching process which 
proceeds as follows. 

Given real numbers < iia < oo, we define xa — ^77+1 (note that < xa < 
1) and fix any event ^o- In the first round of the process, a vertex labeled Aq 
is created. In each subsequent round, for each event vertex v with label Ay in 
the previous round, we carry out a 'subprocess', where for each A^ S r(ti) (in 
the dependency graph), a vertex u with label Au is added as a child of v with 
probability xa^ (the choices are independent). At the end of the subprocess, we 
check if the label-set of the resulting set of children for v is an independent set 
in the dependency graph. If it is not, we delete the children created and restart 
the subprocess. Note that xa < I (for all A) implies that the subprocess will 
eventually end (with probability 1) having produced an independent set. 

Note that the process described above is equivalent to one in which, in each 
round and for each vertex v from the previous round, we create a set of children 
u with labels from a set chosen from all independent sets /„ C T{v), where the 
likelihood of the choice of each independent set is weighted according the the 
product 



\ueh. / \uer(v)\i. 



1 - XA,, 

er{v}\i 

Lemma 2.2 (Improved Branching Lemma). For any strongly proper witness 
tree T with root labeled Aq, the probability pip that the modified branching process 
described above produces exactly the tree T is 

v€T 2^ 11 MA 

/cr(yi„) Aei 

I indcp. 

Proof. Letting Wy = TaiAy) \ ^(rj(ti)), where £{v) is the label of vertex v, we 
have 

n XA^ n (i-^s) 

^, ^ -Q uer+{v) Bew^. 

ueT 

iGT{A^)Aei serG(A,)\/ 

/ indcp. 
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This can be rewritten as 



n T 



Pt 



- ■ XA^ 

-j-j- uer+{v) 



XA 



4-^ ^ ^ i ~ Xa 

/cr(A„) A£I 
I indcp. 

by dividing the top and bottom by n_BerG(A ^xb)- Since taking the double 
product ni,eTnuGr+(t)) ^ equivalent to taking a product n«GT\{Do}' where 
vq denotes the root vertex of T, this gives line (|12p . recalling that xa = ^tj+j 
and so , = ua- □ 

l-XA '^^ 

This is applied now in the same way as the branching lemma used by Moser 
and Tardos, but with regards to the family Ta of strongly proper witness trees 
rooted with A, instead of the family Ta of proper witness trees rooted with A. 
We have 

-rcr(A^) agi 

I indcp. 

Putting this together with line pT|) . we see then that the condition ((Sj of the 
theorem implies that 

E(iVA) < ^iA, (14) 

completing the proof the the Moser- Tardos algorithm still terminates in ex- 
pected time 



A&A 



□ 
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